METHOD AND DEVICE FOR PROCESSING GRAPHICAL INFORMATION 

FOUND ON POSTAL DELIVERIES 

Description: 
5 

Field of the invention 

The invention relates to a method for processing graphic information present 
on mailpieces, whereby the graphic information is acquired, stored and evaluated. 

10 

The invention also relates to a device that is suitable for carrying out the 
method. 

1 5 Description of related art 

German Preliminary Published Application DE 101 50 457 Al describes a 
method as well as a device for processing graphic information present on the surfaces 
of mailpieces. For this purpose, the graphic information present on the mailpieces is 
20 acquired and evaluated locally by an image processing station, whereby it is checked 
whether the acquired graphic information differs from the expected graphic 
. information. In case the acquired graphic information differs from the expected 
graphic information, the acquired graphic information is transmitted to a central 
image processing unit. The mailpieces are physically sorted as a function of the 
25 checking procedure. 

Another method of the generic type as well as a device of the generic type is 
described in German Preliminary Published Application DE 101 50 464 Al, whereby 
the method as well as the device are used especially for checking postage. In order to 
30 check the postage, the postage indicia present on the mailpieces are acquired and 
checked. 

German Preliminary Published Application DE 101 31 254 Al discloses a 
method for verifying the authenticity of a postage indicium applied onto a mailpiece, 
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whereby cryptographic information contained in the postage indicium is decrypted 
and used for verifying the authenticity of the postage indicium. Furthermore, this 
German preliminary published application describes the use of a database for storing 
mail-specific data. Here, especially customer system identification information is 
5 compiled in the database. 

German Patent DE 100 10 241 CI describes a method and a device for reading 
addresses on mailpieces. The invention relates to the reading of the addresses on 
mailpieces, in which process images of the mailpiece surface that have been evaluated 
10 by at least one OCR unit are transmitted to several video encoding stations for manual 
encoding by video encoding personnel if the reading result (also called rejection) was 
not unambiguous. 

German Preliminary Published Application DE 101 50 455 Al discloses a 
1 5 method and a device for processing mailpieces that checks whether the mailpiece has 
postage. If it has no postage, or if the postage differs from the expected postage, then 
a payment assurance code is printed onto the mailpiece. The subsequent sorting 
procedure is carried out as a function of the payment assurance code. 

20 German Patent DE 199 47 259 CI describes a method for sorting mailpieces 

in several sorting runs. In order not to have to read the addresses and not to have to 
print machine-readable identification codes on each mailpiece during each sorting run, 
characteristic features of the mailpieces are additionally ascertained during the first 
sorting run and stored together with the distribution codes acquired in the reading 

25 process. During the subsequent sorting runs, only the characteristic features of the 
mailpieces are acquired and these are compared to the stored features. If they match, 
then the applicable distribution code is assigned to the mailpiece. 

The above-mentioned methods as well as devices share the objective of 
30 checking the mailpieces for correct postage and of only conveying correctly franked 
mailpieces. A drawback of all of the above-mentioned inventions is the fact that the 
physical sorting is subject to a finite number of pre-specified sorting features, 
whereby each acquired case of postage fraud is classified under one of the possible 
sorting features. 



If a new fraud pattern cannot be classified under one of the sorting features, 
then the mailpiece in question is removed from the conveying sequence without it 
being possible for the sorting features to be adapted to this new fraud pattern, which is 
a major drawback of the known methods. Another drawback of the known methods 
lies especially in the fact that each mailpiece - also in the event of a repeated case of 
fraud - passes through a complete postage checking cycle, which comes at the 
expense of the conveying speed of all of the mailpieces. 

Moreover, international patent application WO 02/0822235 describes a system 
for processing goods that are sent back to a merchant by customers. Here, first of all, 
an image of the surface of the packages containing the goods as well as their weight 
are acquired and stored in a database. On the basis of this data, the postage to be paid 
is calculated and compared to the postage that has been applied to the packages in 
order to draw up reports indicating the amount of postage that still has to be paid by 
the merchant. In order to draw up suitable groupings of images for the processing, a 
sorting of the images can be carried out. 

Summary of the invention 

The invention is based on the objective of refining a method of the generic 
type in such a way that mailpieces of a sorting process are processed in a mail 
distribution center or in several mail distribution centers, whereby the sorting 
processes are optimized on the basis of a processing result without this causing any 
delay. In this manner, cases of fraud, for example, due to forged postage indicia, are 
eliminated and all kinds of fraud patterns are recognized. 

This objective is achieved according to the invention with a method of the 
generic type in that, on the basis of a first result of the evaluation of the graphic 
information, a database is augmented by additional sorting features, whereby the 
surface video data contained in the graphic information and/or the statistical 
evaluation are imaged, and whereby moreover, using the augmented database, a 
second result of the evaluation is ascertained so that, on the basis of the results of the 
evaluation, the graphic information of a first mailpiece is sorted, whereby this sorting 
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of the graphic information of the first mailpiece triggers a physical sorting of a second 
mailpiece, and furthermore, in that another physical sorting of the first mailpiece 
resulting from a reference code is carried out. 

5 In particular, the method is suitable for the evaluation of graphic information 

in mail or freight centers. 

Preferably, the method according to the invention allows a determination of 
postage indicia present on the mailpieces. 

10 

Advantageous embodiments of the method are the subject matter of claims 2 

to 27. 

The evaluation according to the invention of the graphic information of the 
15 mailpiece will be referred to in short below as "virtual fine sorting* (virtual FS). The 
term virtual is used in order to express the fact that the appertaining sorting is not 
carried out physically even though the virtual FS determines a physical sorting. 
Fundamentally, the virtual FS with its suitable means allows a sorting of mailpieces in 
a graphic and/or numeric configuration so that especially graphic information of 
20 mailpieces is sorted. Since the virtual FS comprises another checking of the postage - 
referred to below as virtual checking of the postage - unintentional cost- free 
conveying is ruled out according to the invention. 

As a matter of principle, the virtual FS can be integrated at any desired point 
25 of the conveying sequence for mailpieces inside or outside of mail or freight centers. 

The term "virtual" according to the invention also relates to a method for the 
computer-aided evaluation of the graphic information, whereby preferably standard- 
ized computer-aided evaluation methods are used. Moreover, according to the inven- 
30 tion, it has proven to be particularly advantageous to use an evaluation method that is 
specially optimized for the conveying sequence in a mail or freight center. 
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The term "computer" is by no means to be construed in a restrictive fashion. 
This refers to any kind of unit that is capable of performing computations such as, for 
example, a work station, a personal computer or a microcomputer. 

5 Graphic information is information of any kind that is present on the surface 

of the mailpiece and that is conducive for graphic imaging or acquisition. It has been 
found that the term graphic information refers primarily to the postage indicium as 
well as to the sender field on the mailpiece. Moreover, video data of the entire surface 
of the mailpieces constitutes part of the graphic information, so that detailed 
10 information about a mailpiece can also be acquired. Furthermore, the reference code, 
which contains information about the result of an already performed evaluation, is 
also an integral part of the graphic information. After the acquisition has been carried 
out, the graphic information is stored so that the virtual FS can make use of the stored 
data. 

15 

Results of an automated checking of the postage, namely, concrete 
information indicating the sorting compartment into which the mailpiece is placed, are 
printed onto the mailpiece in the form of a one-dimensional or two-dimensional 
barcode, also called a payment assurance code. This one-dimensional or two- 
20 dimensional barcode present on the mailpiece is an example of a reference code. 

The automated checking of the postage is configured according to the 
invention in such a way that correctly franked mailpieces with a complete reference 
code go into a normal conveying sequence without being entered into a database ZinS. 

25 

Mailpiece-relevant data for the optimized support of processing sequences is 
stored in the database ZinS. 

The means for doing this is an expanded utilization of automation in the mail 
30 centers so as to obtain detailed information about automatically processed mailpieces. 
A result is the additional out-sorting of mailpieces into "payment assurance compart- 
ments". 
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Fundamentally, the database ZinS contains information about automated and 
virtual checking of the postage as well as information about the sorting procedures 
that are associated with the checking of the postage. Moreover, results of an 
evaluation of graphic information are stored in the database ZinS. In particular, the 
5 database ZinS has a negative file that contains information about impermissible 
postage indicia. Furthermore, the database ZinS has a positive file that contains 
information about correct postage indicia. 

If no complete reference code is present on the mailpiece, then a reference 
10 code is imprinted on the basis of the automated checking of the postage and said 
reference code determines the associated physical sorting of the mailpieces. The 
physical sorting, as the result of the automated checking of the postage, is done, for 
example, according to the sorting features "insufficient postage" and "suspicion of 
fraud". 

15 

Moreover, the customer-specific cumulative postage amount registered within 
a specifiable period of time as well as the customer-specific cumulative postage 
amount of all paid value cards / value specifications are registered in the database 
ZinS. Moreover, the database contains entries of comparisons between the determined 
20 customer-specific cumulative postage amounts as well as the customer-specific 

cumulative amounts of all paid value cards / value specifications and the amounts of 
an automatic franking procedure read within a reporting time period on the basis of 
acquired sender franking machine (SFM) identifications. 

25 According to the invention, the evaluation of the graphic information is not 

subject to previously determined sorting features, but rather, additional sorting fea- 
tures for future cases of postage fraud arise from a virtual FS. In particular, the results 
of the virtual FS are used to augment the database ZinS, or rather to augment the 
negative file. Consequently, the method according to the invention as well as the 

30 device take into account the fact that forgers of postage indicia make use of 
increasingly refined methods. 

After the graphic information, especially the surface video data of the 
mailpieces, has been acquired, it is stored and is available for evaluation. Preferably, 
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the graphic information is made visible. The storage of the graphic information has 
the major advantage that future customer-specific documentation about conveyed 
mailpieces can be generated in a targeted and timely fashion. The type of evaluation 
can be adapted according to the invention to the requirements within the mail or 
5 freight center. 

Moreover, storing the graphic information has the major advantage that the 
evaluation of the stored information is possible even during operational shutdown 
phases of the conveying system. In this manner, the evaluation of the graphic 
10 information is segregated from the conveying of the mailpieces, so that advanta- 
geously, the evaluation speed of the mailpieces is retained, even during shutdown 
phases, which considerably contributes to allowing the mailpiece to be conveyed in a 
timely fashion. 

15 In an especially preferred embodiment of the invention, in addition to the 

graphic information, data pertaining to the automated checking of the postage is 
likewise stored. 

If, for example, an impermissible postage indicium is recognized on the basis 
20 of the first result of the evaluation of the graphic information of the first mailpiece, 

then the negative file of the database ZinS is augmented as a function of the sorting of 
the graphic information. Another automated and/or virtual checking of the postage 
makes use of the augmented negative file. In cases of fraud, volume analyses of 
customer segments, of individual customers or of faulty structures can easily be 
25 carried out, without intervening in the physical sorting of the first mailpiece that is 
based on the reference code. 

Fundamentally, any reference code can be used. The use of 2 -digit reference 
code has proven to be especially advantageous. Such reference code is used for 
30 further evaluation steps. Moreover, the application of a reference code makes it 

possible to ensure that a mailpiece only undergoes checking of the postage one time 
and/or is only conveyed into an acquisition system one single time. In order to prevent 
double acquisitions, a physical rough sorting is carried out at the beginning of the 
evaluation of the graphic information. 
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In the eventuality of a second instance of fraud with a previously acquired 
fraud pattern, the impermissibly franked mailpieces are physically out-sorted on the 
basis of the previously acquired evaluation results, without having to be bound to pre- 
5 specified sorting features. This further advantage of the method according to the 

invention leads to the registration and recognition of any kind of fraud pattern, which 
results in an extremely high physical out-sorting rate. 

It has proven to be especially valuable to arrange for the evaluation of the 
10 graphic information to take place via a data line at a different point in time and/or at a 
different place than the point in time and/or the place of the physical sorting resulting 
from the reference code. 

A data line as defined in the especially preferred embodiment of the invention 
15 is any medium that serves for the loss- free transmission of data. For example, RS 232 
cables or coaxial cables can be used as data lines so that, in these cases, data 
transmission at speeds of up to 100 Mbps (mega bits per second) are achieved. 

In another preferred embodiment, the evaluation of the graphic information of 
20 the mailpieces comprises statistical evaluations of the graphic information present on. 
the mailpieces. 

Advantageously, the statistical evaluation of the graphic information present 
on the mailpieces provides an additional decision-making criterion for checking the 
25 postage since, in this case, the checking of the postage is not limited to an actual 

classification according to pre-specified sorting features. For this purpose, the surface 
video data and/or the statistical evaluation is imaged on the basis of the graphic 
information and this serves for determining a second result of the evaluation, whereby 
the second result of the evaluation serves to augment the database ZinS. 

30 

On the basis of the graphic information, the types of postage of the mailpieces 
are determined and this serves for ascertaining another result of the evaluation, 
whereby the results of the determination of the type of postage are output in the form 
of a code. 
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Fundamentally, any configuration of the postage indicium can be acquired but 
it has proven to be especially advantageous to acquire and evaluate postage indicia 
generated by a sender franking machine (SFM) or else computer-based digital postage 
indicia. 

It is especially advantageous to acquire all postage imprints of a postage 
indicium generated by an SFM, whereby the postage indicium contains especially the 
SFM identification as well as the date when the postage indicium was generated. 

The authenticity of sender franking is verified in that the graphic information 
present on the mailpieces is compared to the information expected for this mailpiece, 
whereby the expected information corresponds to a determination that preceded the 
comparison, and moreover, the postage indicium is registered as being forged if the 
information at hand differs from the expected information. 

Preferably, determinations ensue from an evaluation of mailpieces preceding 
the comparison, whereby the evaluation entails a changing number of sorting features. 

Fundamentally, the virtual checking of the postage comprises at least the same 
number of sorting features as the automated checking of the postage. 

Preferably, the virtual checking of the postage comprises a number of 
additional sorting features. For example, another sorting feature is the SFM 
identification ("identification") determined through the evaluation. Moreover, on the 
basis of another sorting feature, it is checked whether an SFM identification is 
readable ("SFM identification not readable"). Furthermore, on the basis of a sorting 
feature, it is checked whether a determined SFM identification is present in a negative 
file ("SFM in negative file"). Likewise, on the basis of a sorting feature, it is checked 
whether a determined SFM identification is present in a positive file ("SFM not in 
positive file"). In addition, on the basis of a sorting feature, it is checked whether this 
is a case of SFM insufficient postage ("SFM insufficient postage"). On the basis of 
additional sorting features, it is checked whether an SFM currency is readable ("SFM 
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currency not readable"), and moreover, whether an SFM postage indicium is readable 
("SFM postage indicium not readable"). 

The digital postage indicia contain cryptographic information, for example, 
5 about the identity of the customer system that controls the generation of the postage 
indicium. The decryption of the cryptographic information contained in the postage 
indicium is part of the evaluation of the graphic information. By integrating the 
decryption of the cryptographic information into the evaluation process, it is possible 
to directly verify the authenticity of the digital postage indicia. 

10 

Moreover, it is advantageous for another partial evaluation to comprise a 
comparison between the date when the digital postage indicium was generated and the 
current date. The integration of the date when the digital postage indicium was 
generated - especially in encrypted form - increases the data security, since the 
1 5 comparison between the date when the digital postage indicium was generated and the 
current date prevents a multiple use of a given digital postage indicium for conveying 
mailpieces. 

Due to the preferred generation technique of such digital postage indicia in 
20 personal computers (PC), this type of franking is also referred to as PC franking 

(PCF). However, these elaborations also apply to other digital postage indicia that can 
be generated, for example, by means of suitable large-volume printers or by means of 
franking machines configured for printing digital postage indicia. 

25 The authenticity of a digital postage indicium is verified in that the encoded 

digital information contained in the graphic information is deciphered and compared 
to the unencrypted graphic information present on the appertaining mailpiece to see if 
it matches and, if it does not match, the postage indicium is registered as being forged. 

30 Moreover, a preferred embodiment of the invention allows another checking 

of the postage, whereby a hash value is generated from data contained in the graphic 
information in order to check whether this hash value matches a hash value contained 
in the encoded information and, if it does not match, the postage indicium is 
registered as being forged. For this purpose, the hash value is formed taking into 



11 

account information about mailpiece data, taking into account a temporarily stored 
random number and taking into account a loading procedure identification number. 

This gives rise to additional sorting features of the virtual checking of the 
5 postage. In particular, on the basis of another sorting feature, it is checked whether the 
hash value of the PCF is OK ("PCF hash value not OK"). Moreover, on the basis of 
additional sorting features, a date of a PCF ("PCF date") is checked, a PCF version 
("PCF version") is checked, PCF insufficient postage ("PCF insufficient postage") is 
checked and/or the presence of a determined PCF in a negative file ("PCF in negative 
10 file") is checked. 

In addition to the above-mentioned sorting features of the checking of the 
postage, the graphic information of the mailpiece is evaluated according to other 
sorting features, leading to a further structuring of the evaluation. 

15 

For example, a sorting feature of the evaluation is a time of day of a sorting 
event, which allows a retrospective analysis of a mailpiece that has already been con- 
veyed. 

20 Another sorting feature of the evaluation is the date of a sorting event. In this 

manner, registered cases of fraud can advantageously be classified under the registra- 
tion date, which allows retroactive relationships to be established so as to recognize 
trends of fraud events over a prolonged period of time. 

25 Moreover, additional sorting features of the evaluation are a starting time 

and/or an ending time of a sorting event. By indicating a preferred time interval in the 
form of starting and ending times of a sorting event, a precise time breakdown of the 
virtual FS is obtained, which also allows additional conclusions to be drawn about 
coincidences during the conveying processes of mailpieces. 

30 

Another sorting feature of the evaluation is a specification of production 
machines in a mail or freight distribution center based on a machine number, so that a 
global inclusion of all of the systems involved in the conveying processes is carried 
out and documented. 
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Additional sorting features are the value of the insufficient postage determined 
by means of the evaluation as well as the SFM identification determined by means of 
the evaluation. 

5 

In another preferred embodiment of the invention, at least one means for 
evaluating the graphic information of the mailpieces is located inside and/or outside 
of a mail distribution center. 

10 Through a spatial separation of the evaluation and the conveying, it is left up 

to a user of the method to check the postage either in the immediate vicinity of the 
conveying or else at a distance away from it. For example, the evaluation of the 
graphic information can be evaluated by users at any desired location, as long as the 
means for performing the evaluation is an integral part of the data network. 

15 

In this manner, special user groups can be created that are physically 
concentrated away from the place where the mailpieces are conveyed, resulting in a 
substantial increase in the evaluation efficiency. 

20 Furthermore, the above-mentioned objective is achieved in conjunction with a 

device, referred to below as a "virtual fine sorting machine" (virtual FSM), corre- 
sponding to the generic part of claim 28, in that the data network is connected to at 
least one means for performing a physical sorting of mailpieces, at least one means 
for generating a reference code, and at least one means for evaluating the graphic 

25 information, so that the means for evaluating the graphic information of a first 

mailpiece ascertains a first result of the evaluation, whereby the data network is also 
connected to a database that has been augmented by an additional sorting feature, for 
determining a second result of the evaluation and additionally, at least one means for 
performing the physical sorting of a second mailpiece is activated, whereby another 

30 physical sorting of the first mailpiece is carried out on the basis of the reference code. 

Advantageous embodiments of the device are the subject matter of claims 29 

to 33. 
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Within the scope of the virtual FSM according to the invention, a data network 
consists of a complex system of data-processing means and of the data lines that 
connect the data-processing means, whereby a network can be distinguished from 
another network by its configuration. 

5 

The data network allows the linking of a plurality of data-processing means. 
Preferably, central storage devices, printers and data scanners are connected to each 
other and can be used. An especially advantageous aspect of the device according to 
the invention has proven to be the use of different types of network cards for the data 

10 transport. For example, local networks (LANs), wide-area networks on the basis of 
telephone lines (WANs), homogeneous data networks (networks with the same type 
of computers and software) and heterogeneous data networks (networks with different 
types of computers and software) can be used according to the invention. By the same 
token, it is possible to combine individual types of networks or all of the above- 

15 mentioned types of networks with each other. Furthermore, in an especially preferred 
embodiment of the virtual FSM, a data transport via a data server is made possible. 

The means for performing the physical sorting of mailpieces is characterized 
according to the invention in that the number of sorting compartments corresponds to 
20 at least the number of the sorting features resulting from the reference code. 

Advantageously, the means for performing the physical sorting provides additional 
sorting compartments, whereby the number of additional sorting compartments is 
determined by the results of the virtual FS. 

25 According to the invention, the means for generating the reference code is 

configured in such a way that the graphic information of each mailpiece that is present 
in a mail distribution center and that is ready to be conveyed further is acquired by at 
least one analog and/or digital reading means. Therefore, the acquisition according to 
the invention of the graphic information leads to an analog and/or digital 

30 representation of the surfaces of the mailpieces. The acquired representations of the 

surfaces are stored by at least one means for storing analog or digital signals, whereby 
the storage is fundamentally independent of the location of the acquisition. 
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The reading means consists of a combination of a code reading unit for 
reading in the postage indicium and a video data recording unit for generating a video 
recording of the entire surface of the mailpiece. Moreover, if so desired, the reading 
means can consist of two physically separated units, one unit serving to read the 
5 postage indicium and the other unit serving to create a video recording of the data on 
the surface of the mailpiece. 

It has proven to be advantageous to use special reading devices to allocate the 
graphic information to standardized franking systems. 

10 

For example, the specialized reading device deciphers the encoded data 
contained in the graphic information and compares this decoded data to other 
information from a database. 

15 According to the invention, the means for evaluating the graphic information 

can be combined with the means for generating the reference code. 

Preferably, the means for evaluating the graphic information is connected to 
the data network in such a way as to be spatially and functionally separated from the 
means for generating the reference code. 

20 Another embodiment of the virtual FSM is characterized in that at least one 

means for evaluating the graphic information of the mailpieces has at least one input 
device as well as at least one display device so that evaluation results as well as 
surface video data of the mailpieces are displayed to a user and edited by the user 
employing the input device. 

. 25 

Another characteristic of the virtual FSM, depending on the structural design, 
is to use different display devices for depicting the evaluation results and the video 
data. For example, conventional analog and/or digital video equipment can be used as 
display devices. Moreover, PC-based display devices can be used that allow a filtering 
30 of the video data and thus a detailed depiction of specific segments of the video data. 

The input device is an interface for representing and transmitting information. 
For example, PC keyboards, numerical keypads, barcode scanners, speech recognition 
means, etc. are used to generate the input. 
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Additional advantages, special features and practical refinements of the 
invention can be gleaned from the subordinate claims and from the presentation below 
of preferred embodiments making reference to the drawings. 

5 

Brief description of the drawings 

The drawings show the following: 

10 Figure 1 depiction of the method according to the invention on the basis 

of a schematic flow chart. 

Figure 2 depiction of an example of a display according to the invention 
of evaluation results, broken down according to sorting features. 

15 

Figure 3 depiction of an example of the number of virtual compartments 

after the evaluation has been completed, taking into account SFM and PCF data 
records. 

20 Figure 4 depiction of an example of a display according to the invention 

of evaluation results as well as of details of the graphic information. 

Figure 1 shows a depiction of a preferred embodiment of the invention in the 
form of a flow chart for processing graphic information present on mailpieces. 

25 

The graphic information 20 present on mailpieces and schematically 
configured in the form of input information 10 is acquired and fed to a storage device 
30. The storage device here is configured so as not to be volatile, so that the graphic 
information is stored permanently. Moreover, on the basis of the acquired graphic 
30 information, it is checked whether the reference code 40 is already present. If the 
result of the checking for the presence of the reference code is positive 01, it is also 
checked whether the correct franking is present. If the result of the checking for 
correct franking is also positive 01, then the appertaining mailpiece is transferred to a 
normal conveying sequence 60. 
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If the result of the checking for the presence of the reference code 40 is 
negative 02, then an automated checking 50 of the postage is carried out. The result of 
the automated checking of the postage specifies a reference code, whereby the addi- 
tional reference code 80 is printed onto the mailpiece. As a function of the reference 
code, the mailpieces are physically sorted 100, whereby the sorting takes place 
according to the sorting features 120. 

If the result of the checking for correct franking 70 is also negative 02, and if a 
reference code is already present, then the mailpieces are once again physically sorted 
according to sorting features 120 as a function of the reference code. 

Figure 2 shows an especially preferred embodiment of the device according to 
the invention on the basis of the display of evaluation results broken down according 
to sorting features. 

On the basis of a structured presentation form, typical evaluation results, 
broken down according to sorting features, are displayed by means of the display 
device 130. Here, the results are listed according to the day 140, the starting and 
ending time 150, the machine number 160, the utilized payment assurance sorting fea- 
tures 170, the ascertained insufficient postage value 180 as well as according to the 
ascertained SFM identification 190. 

Figure 3 shows another preferred embodiment of the invention. On the basis 
of the acquired graphic information, the authenticity of the SFM and PCF postage 
indicia is verified, so that the graphic information in this embodiment is sorted 
graphically - into virtual compartments. The results of the virtual checking 90 of the 
postage are classified under the employed sorting features and displayed on the 
display device 130. In the depiction shown by way of an example in Figure 3, for 
instance, the following number of mailpieces could be sorted into the virtual 
compartments provided for them: 

In the case of three mailpieces, the determined SFM identification is already in 
the negative file so that their graphic information is allocated to the virtual compart- 
ment "SFM in negative file" 200. None of the evaluated SFM identifications was 
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previously in the positive file so that no graphic information is present in the virtual 
compartment "SFM in positive file" 210. Moreover, no SFM insufficient postage 
could be ascertained by the virtual checking of the postage, as a result of which the 
virtual compartment "SFM insufficient postage" 220 does not contain any graphic 
5 information. However, all in all, seven mailpieces could be found whose SFM 

identification was not readable, which leads to a set of 7 items of graphic information 
in the virtual compartment "SFM not readable" 230. Moreover, the SFM currency 
("SFM currency not readable" 240) was not readable for nine mailpieces, and the 
SFM franking ("SFM franking not readable" 250) was not readable for three 
10 mailpieces. 

Further results of the evaluation show that no mailpiece with an incorrect PCF 
hash value was found by the evaluation (no graphic information in the compartment 
"PCF hash value not OK" 260), and furthermore that one mailpiece was found that 

15 had an impermissible PCF date, an impermissible PCF version and/or PCF 

insufficient postage. The last evaluation result of this example shows that one 
mailpiece was already in the PCF negative file ("PCF in negative file" 280). The 
above-mentioned graphic display of the evaluation results is such that, by means of a 
graphic activation on the display device or by means of the input device, all of the 

20 graphic information complied in a given virtual compartment is listed. 

In the case of the embodiment according to Figure 3, the display device 130 is 
also provided with two additional operating units on the front faceplate. By actuating 
the operating unit 290, all of the evaluation results are stored. Actuating the operating 
25 unit 300 exports the data of all of the evaluation results to an external data medium 
that is located outside of the data network. 

Figure 4 shows another embodiment based on the display according to the 
invention of evaluation results as well as of details . of the graphic information 310. 
30 The display of graphic information is activated by means of the operating unit 320 on 
the faceplate of the display device 130. Moreover, another operating unit 330 allows a 
targeted image processing of the graphic information. Here, either individual areas of 
the displayed graphic information or else graphic information of mailpieces that differ 
from each other can be selected. 
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List of reference numerals 

01 yes 

02 no 

5 10 input information 

20 acquisition of the graphic information 

30 storage device 

40 checking for the presence of a reference code 

50 automated checking of the postage 

10 60 normal conveying sequence 

70 checking for correct franking 

80 printing of the reference code 

90 virtual FS 

1 00 physical sorting 

15 110 database ZinS 

1 20 sorting features 

130 display device 

140 indication of the date 

150 indication of the starting and ending time 

20 160 indication of the machine number 

170 indication of the payment assurance sorting feature 

180 indication of the ascertained insufficient postage value 

190 indication of the ascertained SFM identification 

200 number of compartments in the negative file for mailpieces with SFM 

25 postage 

210 number of compartments in the positive file for mailpieces with SFM 
postage 

220 number of compartments for mailpieces with insufficient postage with 
SFM postage 

30 230 number of compartments for mailpieces whose SFM identification is 

not readable 

240 number of compartments for mailpieces whose SFM currency is not 
readable 
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250 number of compartments for mailpieces whose SFM franking is not 
readable 

260 number of compartments for mailpieces whose PCF hash value is not 
readable 

270 number of compartments for mailpieces for which an impermissible 
PCF date, an impermissible PCF version and/or PCF insufficient postage was 
ascertained 

280 number of compartments for mailpieces whose SFM identification is 
not readable 

290 operation for purposes of storing the evaluation results of the virtual 

FS 

300 operation for purposes of exporting data of the evaluation results of the 
virtual FS 

3 1 0 depiction of the acquired graphic information 

320 operation for purposes of activating the depiction of the acquired 
graphic information 

330 operation for purposes of processing the graphic information 

340 free surface for advertising imprints 
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Claims 

1 . A method for processing graphic information present on mailpieces, 
whereby the graphic information is acquired, evaluated and stored, and whereby the 
acquired graphic information is used for physically sorting mailpieces, 

characterized in that, 

on the basis of a first result of the evaluation of the graphic information, a 
database is augmented by additional sorting features, whereby the surface video data 
contained in the graphic information and/or the statistical evaluation are stored, and 
whereby moreover, on the basis of the augmented database, a second result of the 
evaluation is ascertained so that, on the basis of the results of the evaluation, the 
graphic information of a first mailpiece is sorted, whereby this sorting of the graphic 
information of the first mailpiece triggers a physical sorting of a second mailpiece, 
and furthermore, in that another physical sorting of the first mailpiece resulting from a 
reference code is carried out. 

2. The method according to claim 1, 
characterized in that 

a determination of postage indicia present on the mailpieces is carried out. 

3. The method according to one or more of the preceding claims, 
characterized in that 

the evaluation of the graphic information takes place via a data line at a differ- 
ent point in time and/or at a different place than the point in time and/or the place of 
the physical sorting resulting from the reference code. 

4. The method according to one or more of the preceding claims, 
characterized in that 

the evaluation of the graphic information of the mailpieces comprises a 
statistical evaluation of the graphic information present on the mailpieces. 
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5. The method according to one or more of the preceding claims, 
characterized in that 

the authenticity of sender franking is verified in that the graphic information 
present on the mailpieces is compared to the information expected for this mailpiece, 
5 whereby the expected information corresponds to a determination that preceded the 
comparison, and moreover, the postage indicium is registered as being forged if the 
information at hand differs from the expected information. 

6. The method according to one or more of the preceding claims, 
characterized in that 

the authenticity of a digital postage indicium is verified, whereby the encoded 
digital information contained in the graphic information is deciphered and compared 
to the unencrypted graphic information present on the appertaining mailpiece to see if 
it matches and, if it does not match, the postage indicium is registered as being forged. 

7. The method according to claim 6, 
characterized in that 

a hash value is generated from data contained in the graphic information in 
order to check whether this hash value matches a hash value contained in the encoded 
information and, if it does not match, the postage indicium is registered as being 
forged. 

8. The method according to claim 7, 
characterized in that 

25 the hash value is formed taking into account information about mailpiece data, 

taking into account a temporarily stored random number and taking into account a 
loading procedure identification number. 

9. The method according to one or more of the preceding claims, 
30 characterized in that 

the evaluation of the graphic information of the mailpiece is carried out 
according to sorting features. 
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10. The method according to one or more of the preceding claims, 
characterized in that 

the time of day of a sorting event is a sorting feature of the evaluation. 

1 1 . The method according to one or more of the preceding claims, 
characterized in that 

another sorting feature of the evaluation is the date of a sorting event. 

12. The method according to one or more of the preceding claims, 
characterized in that 

another sorting feature of the evaluation is the starting time and/or the ending 
time of a sorting event. 

13. The method according to one or more of the preceding claims, 
characterized in that 

another sorting feature of the evaluation is the specification of production 
machines in a mail or freight distribution center. 

14. The method according to one or more of the preceding claims, 
characterized in that 

another sorting feature is the value of the insufficient postage determined by 
means of the evaluation. 

15. The method according to one or more of the preceding claims, 
characterized in that 

another sorting feature is the SFM identification determined by means of the 
evaluation. 

16. The method according to claim 15, 
characterized in that 

as another sorting feature, it is checked whether the SFM identification is 
readable. 
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17. The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, it is checked whether the determined SFM 
identification is present in a negative file. 

18. The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, it is checked whether the determined SFM 
identification is present in a positive file. 

19. The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, it is checked whether this is a case of SFM insuffi- 
cient postage. 

20. The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, it is checked whether the SFM currency is readable. 

21 . The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, it is checked whether the SFM postage indicium is 
readable. 

22. The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, the date of a PCF ("PCF date") is checked. 

23. The method according to one or more of the preceding claims, • 
characterized in that 

as another sorting feature, it is checked whether a PCF version ("PCF version") 
is present. 
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24. The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, it is checked whether PCF insufficient postage 
("PCF insufficient postage") is present. 

25. The method according to one or more of the preceding claims, 
characterized in that 

as another sorting feature, it is checked whether a determined PCF is present 
in a negative file ("PCF in negative file"). 

26. The method according to one or more of the preceding claims, 
characterized in that 

data of the automated checking of the postage is stored. 

27. The method according to one or more of the preceding claims, 
characterized in that 

results of the evaluation of graphic information are stored in a database. 

28. A device for processing graphic information present on the surfaces of 
mailpieces comprising one or more image processing units, whereby the image proc- 
essing units have means for acquiring, evaluating and storing the graphic information 
of mailpieces, and having at least one means for recognizing different types of 
postage of the mailpieces, whereby the image processing units as well as the means 
for recognizing the types of postage are in a data network, 

characterized in that 

the data network is connected to at least one means Vor performing a physical 
sorting of mailpieces, at least one means for generating a reference code, and at least 
one means for evaluating the graphic information, so that the means for evaluating the 
graphic information of a first mailpiece ascertains a first result of the evaluation, 
whereby the data network is also connected to a database that has been augmented by 
an additional sorting feature, for determining a second result of the evaluation and 
additionally, at least one means for performing the physical sorting of a second 
mailpiece is activated, whereby another physical sorting of the first mailpiece is 
carried out on the basis of the reference code. 
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29. The device according to claim 28, 
characterized in that 

at least one means for evaluating the graphic information of the mailpieces is 
located inside and/or outside of a mail distribution center. 

30. The device according to one or both of claims 28 and 29, 
characterized in that 

at least one means for evaluating the graphic information of the mailpieces has 
at least one input device as well as at least one display device so that evaluation 
results as well as surface video data of the mailpieces are displayed to a user and 
edited by the user employing the input device. 

3 1 . The device according to claim 30, 
characterized in that 

conventional analog and/or digital video equipment is used as display devices. 

32. The device according to one or both of the preceding claims 30 or 3 1 , 
characterized in that 

PC-based display devices are used that allow a filtering of the video data and 
thus a detailed depiction of specific segments of the video data. 

33. The device according to claim 30, 
characterized in that 

the input devices consist of PC keyboards, numerical keypads, barcode scan- 
ners and/or means for speech recognition. 



